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ABSTRACT 
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The  focus  of  this  thesis  is  an  algorithm  to  solve  integer  programming 
problems  with  variable  resource  levels.  Problems  of  this  nature  have 
never  before  been  solved.  We  consider  problems  of  the  form: 


max  I      r.x. 
j=l  ^  "^ 

n 
such  that   y   a  .X  <  b.  +  Gd. 
.1=1  iJ  J    ^ 


n 

for  1  =  1,. . . ,m 


x.=Oorl  j=l,...,n 

r.>0   a..>0   b.>0   d.  >'0        i  =  l,...,ni 
J  ■     iJ  ■     ■•       ^  j  =  l,...,n 

for   0  <  0  <  1 

The  algorithm  has  been  implemented  in  Fortran  and  generates  all 
optimal  zero-one  solutions  which  lie  on  the  line  segment  from  B  to 
B+D.  Current  capacity  is  a  30  by  60  problem.  A  typical  10  by  28 
problem  was  solved  in  20  seconds  on  an  IBM  370/168. 

The  thesis  presents  a  brief  overview  of  parametric  integer  program- 
ming; a  discussion  of  the  integer  programming  algorithm  upon  which 
our  parametric  algorithm  is  based;  the  parametric  algorithm  itself 
and  the  theory  behind  it;  results  from  running  a  variety  of  test 
problems;  directions  for  using  the  code;  and  suggestions  for  further 
research. 
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I.  INTRODUCTION 


The  general  integer  program  (IP)  is  stated  as  follows 

n 

IP:   max   7   r.x.  (the  objective  function) 


j=l  J  J 


b .     for  i  =  1 , . . .  ,m 


such  that   y   a..x.  <  _, 
j=l  '^  ^         ' 

X.  an  integer        j  =  1,. . .  ,n 

J 

In  this  paper  we  shall  consider  only  the  non-negative  zero-one 
case;  i.e.  we  shall  require  r-  >  0,  a.-  >  0,  and  b^.  >  0  for  all  i, 
j,  and  X.  =  0  or  1  for  all  j. 

A  parametric  integer  program  (PIP)  is  developed  from  an  integer 
program  by  allowing  the  objective  function  (r.  above),  the  constraint 
matrix  (a.^  above),  or  the  right  hand  side  (b.  above)  to  vary.  This 
paper  focuses  on  varying  the  right  hand  side. 

Our  problem  becomes 

n 

PIP:  max  I      r.x. 
j  =  l  "^  ^ 


n 
such  that   y   a..x.  <  b.  +  0d.  for  i  =  l,...,m 


that  l__^   a.  .X.  ,  b.  .  0d. 


X.  =  0  or  1  j  =  1,. . .  ,n 

r.^0   a.->0   b.^8   d.>0        i=l,...,m 
J      ^J      ^       '  j  =  l....,n 

for    0  <  0  s  1 

Each  right  hand  side  b^.  is  replaced  by  an  interval  L^^.b^.+d^^ 
and  solutions  to  the  problem  are  sought  throughout  the  interval. 
For  convenience  we  shall  use  B  to  refer  to  the  vector  (b^-.-.b^^) 
and  D  to  refer  to  (dj,...,d^). 
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The  parameter  q  is  used  to  help  us  travel  through  this  interval. 
As  0  varies  from  0  to  1,  the  expression  b.+od.  includes  all  points 
in  the  interval.  In  a  one-dimensional  case  we  could  solve  our 
problem  for  all  points  in  the  interval.  It  is  important  to  notice 
that  in  the  multidimensional  case  we  travel  in  a  particular  direction 
D  in  the  m-dimensional  interval  [b,  B+dJ.  A  variety  of  D's  may  be 
used,  but  for  any  particular  D  our  solution  set  will  contain  all  the 
solutions  that  lie  on  the  particular  line  segment  from  B  to  B+D,  but 
not  necessarily  all  the  solutions  in  the  m-dimensional  interval. 

The  theory  on  which  our  work  is  based  was  developed  by  Marsten 

and  Morin  (6,7,8)  and  will  be  discussed  in  section  III.  Our  project 

i 
has  been  the  implementation  of  this  theory.  We  have  developed  a  com-      j 

puter  code  and  some  practical  shortcuts.  We  have  run  a  variety  of 

test  problems  to  investigate  the  nature  of  the  PIP  problem  and  its 

solutions  and  to  investigate  some  particular  practical  aspects  of 

using  our  code  such  as  space,  time,  the  size  of  the  problem  and  the 

size  of  the  D  vector.  Section  IV  contains  a  discussion  of  our  results. 

Section  V  has  advice  for  the  user  of  the  code:  we  have  discovered 

that  its  use  is  an  art  as  well  as  a  science. 

A  short  summary  of  the  history  of  linear  programming  and 
integer  programming  will  put  our  work  in  perspective. 

Linear  programming  problems  were  first  conceived  and  solved  by 
Dantzig,  who  published  his  simplex  method  in  1947  (1).  Integer  pro- 
gramming traces  its  development  from  1958  when  Gomory  invented  the 
cutting  plane  method  (4).  Shortly  thereafter  in  1963  Little  et  al 
proposed  branch  and  bound  techniques  for  solving  integer  problems  (5). 


For  a  state  of  the  art  survey  of  algorithms  for  integer  programming 
see  Geoff rion  and  Marsten  (3)  and  Garfinkel  and  Nemhauser  (2). 

Sensitivity  analysis  and  parametric  analysis  for  integer  prob- 
lems have  only  recently  been  attempted.  Seminal  papers  in  this  field 
are  those  of  Nauss  (9),  Roodman  (13,14)  and  Marsten  and  Morin. 

Our  project,  the  computer  implementation  of  the  theory  developed 
by  Marsten  and  Morin,  is  the  first  working  program  which  actually 
solves  parametric  integer  problems. 


8 


II.  LAYMAN'S  DESCRIPTION 

Our  project  has  been  to  write,  test,  use  and  report  on  a  com- 
puter code  for  solving  integer  programming  problems  with  variable 
right-hand  sides.  Our  code  has  been  grafted  on  to  a  more  general 
integer  programming  code  to  solve  IP  problems  with  fixed  right-hand 
sides. 

Integer  programming  is  a  technique  for  solving  a  set  of  simul- 
taneous linear  inequalities  whose  solutions  must  be  integers,  A 
linear  function  of  the  variables  is  maximized  subject  to  linear  con- 
straints. For  example,  the  dollar  value  of  the  cargo  of  an  airplane 
may  be  maximized  subject  to  weight  and  volume  restrictions.  These 
restrictions  are  the  "right-hand  sides"  and  can  also  be  thought  of 
as  "resource  levels".  The  cost  of  a  diet  could  be  minimized  subject 
to  minimum  vitamin,  mineral  and  calorie  requirements.  The  output  of 
a  factory  could  be  maximized  subject  to  limits  on  available  materials, 
personnel  and  money. 

A  general  linear  programming  solution  would  give  the  best  solu- 
tion to  the  above  problems  assuming  a  continuum  of  possible  amounts 
of  the  variables:  e.g.  7.3  grams  of  carrots  per  week,  or  37,62 
workers  in  the  factory.  An  integer  solution  would  allow  only  whole 
suitcases,  or  apples,  or  workers,  or 'dollars.  Our  program  operates 
in  an  even  more  restrictive  environment,  as  we  allow  only  "0  or  1" 
or  "yes  and  no"  solutions  for  each  variable.  This  is  not  a  major 
problem,  as  it  is  possible  to  repeat  a  variable  to  allow  a  solution 
to  contain  two  or  more  of  the  same  item. 


The  following  examples  are  included  in  an  attempt  to  give  the 
reader  an  introductory  grasp  of  the  types  of  problems  our  program 
could  solve. 

You  are  embarking  on  a  trip  to  the  moon.  You  know  what  you  must 
take  and  you  have  a  list  of  60  optional  items  (objects,  people,  plants, 
and  animals)  which  you  would  like  to  take  along.  You  are  besieged  by 
your  friends  and  fellows  scientists  to  consider  their  pet  projects. 
Each  item  has  a  known  weight,  volume,  food  requirement,  water  require- 
ment, and  oxygen  requirement.  Which  should  you  take? 

First  it  is  necessary  to  assign  a  comparative  numerical  value 
to  each  item.  It  may  be  worth  200  to  take  your  friend  Marshall  (you 
value  both  his  company  and  his  expertise),  but  only  7  to  take  along 
your  pet  dog;  the  chocolate  bar  is  purely  for  pleasure  and  worth  1, 
but  the  extra  film  will  mean  more  data  for  your  colleagues  and  is 
worth  10. 

If  there  is  only  one  spaceship  in  v/hich  to  fly,  the  solution  to 
your  problem  is  straightforward.  You  maximize  the  value  of  your 
optional  cargo  subject  to  the  constraints  of  volume  and  weight.  You 
might  well  end  up  with  the  chocolate  bar  and  not  the  film  because 
the  chocolate  bar  fits  in  and  you  would  have  had  to  remove  something 
more  valuable  to  take  the  film. 

If  there  is  a  choice  among  three  available  spaceships  of  dif- 
ferent capacities,  you  can  solve  the  problem  for  each  one  and  compare 
the  value  of  the  solutions. 

Suppose  all  existing  spaceships  are  too  small  for  you  and  you 
are  asked  for  specifications  for  a  new  one.  A  ship  large  enough  for 

10 


all  60  items  is  clearly  too  expensive.  At  what  level  should  you 
compromise? 

Our  program  can  be  used  to  determine  just  how  much  extra  value 
you  will  get  as  you  increase  capacity.  As  you  increase  weight 
and/or  volume  restrictions  an  increasingly  valuable  cargo  mix  can 
be  included. 

A  mathematical  statement  of  this  example  might  be: 
max   ZOOM  +  7D  +  IC  +  lOF        (objective  function) 
such  that    175M  +  250  +  .5C  +  2F  <  150  +  0  150   (weight  constraint) 
BOM  +  100  +  .IC  +  .6F  <  30  +  0  30   (volume  constraint) 
M,  D,  C,  F  =  0  or  1  (integer  constraint) 

At  0  =  0  Marshall  could  not  come  along  but  everything  else 
could.  This  solution  would  have  weight  =  27.5,  volume  =  10.7,  and 
an  objective  function  value  of  18.  At  0  =  2/3  you  would  take  Marshall 
but  nothing  else.  This  solution  would  have  weight  =  175,  volume  =  50, 
and  value  =  200. 

It  is  obviously  foolish  to  build  a  spaceship  with  capacity 
0  <  0  <  2/3. 

As  0  is  increased  marginally  past  2/3,  you  can  include  first 
the  candy,  then  the  film,  and  then  both.  Even  at  0  =  1,  you  cannot 
take  your  dog. 

Perhaps  weight  and  volume  need  not  increase  at  the  same  rate. 
Your  technicians  inform  you  that  the  absolute  weight  limitation  is 
200,  but  the  volume  can  be  tripled  if  necessary.  In  this  case,  the 
volume  and  weight  constraints  become: 

n 


175M  +  25D  +  .5C  +  2F  <  150  +  0  75 
50M  +  lOD  +  .IC  +  .6F  <  30  +  0  90 

You  learn  that  to  take  everything  you  would  need  a  weight 
allowance  of  202.5.  Only  2h   pounds  over  the  engineers'  absolute 
maximum  would  give  you  the  companionship  of  your  pet  as  well  as 
Marshall,  the  candy  bar,  and  the  film  and  increase  the  value  of  your 
cargo  by  7.  You  confer  with  the  engineers.  "Impossible",  they  reply. 
But  the  light  dawns--a  solution  occurs:  Marshall  diets  and  you 
embark  with  all  your  valuables. 

For  our  second  example,  let  us  choose  a  more  practical  situation. 
You  have  $900  to  invest.  Two  securities  are  available;  hundred  dollar 
bonds  paying  5%,  and  thousand  dollar  certificates  of  deposit  paying 
8%.  An  ordinary  IP  solution  would  maximize  your  investment  income 
for  the  year  at  5%  of  $900  or  $45. 

When  you  use  variable  resource  levels  you  will  discover  that  if 
you  had  $1000  you  could  earn  $80.  You  will  therefore  borrow  $100  at 
a  cost,  say  of  $10,  and  net  $70  on  your  $900. 

Variable  resource  solutions  allow  you  to  discover  the  critical 
amounts  of  additional  resources  to  add  value  to  your  cargo  or  port- 
folio and  allow  you  to  choose  to  amend  or  not  to  amend  your  original 
resource  allocations  accordingly. 

For  our  third  and  final  profit-maximizing  flight  of  fancy  we 
shall  endow  you  with  a  factory  and  some  extra  money.  You  have  clever 
analysts  who  can  accurately  calculate  the  extra  profit  available  from 
extra  men,  or  extra  raw  materials,  or  new  machines.  By  plugging 
their  numbers  into  our  code,  you  will  discover  in  minutes  the  optimal 
way  to  apportion  your  extra  money  amongst  these  intriguing  alternatives. 
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III.  THEORY 

This  section  describes  the  algorithm  we  have  used  and  its 
theoretical  justification. 

The  paramatric  integer  orogramming  algorithm  was  developed  as 
an  extension  of  the  integer  programming  algorithm  MMDP  written  by 
Marsten  and  Morin  (6).  We  shall,  therefore,  begin  by  first  intro- 
ducing some  general  concepts  used  by  MMDP,  then  discussing  the  MMDP 
algorithm  in  its  simplest  (pure  zero-one)  form,  and  finally  present- 
ing the  parametric  algorithm  as  we  have  used  it. 

The  integer  programming  problem  to  be  solved  by  MMDP  is  stated 

as  follows: 

n 
IP:   max  I      r.x.        (the  objective  function) 
j=l  ^  ^ 


such  that  I      a..x.  <  b.      for  i  =  l,...,m 
j=l  ^-^  ^        ^ 


X.  =  0  or  1 

r.  >  0,  a..  >  0  and  b.  >  0  for  all  i,j. 
The  problem  is  solved  iteratively,  combining  the  techniques  of 
branch  and  bound  and  dynamic  programming. 

Let  us  consider  a  stage  corresponding  to  each  variable.  At 
stage  1  we  create  two  candidate  problems  by  fixing  variable  xi=0  in 
the  first  problem  and  Xi=  1  in  the  second.  For  each  candidate 
problem  (CP)  at  stage  1  we  then  create  two  more  candidate  problems 
at  stage  2  by  fixing  Xj  at  X2  =  0  and  X2  =  1. 

At  stage  k  we  shall  then  have  a  list  of  up  to  2  candidate 
problems.  We  shall  number  these  with  superscripts  for  convenience 
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and  discuss  candidate  problem  q. 

Candidate  problem  q  (called  CP^)  at  stage  k  has  k  fixed  variables 
X.  which  consume  a  defined  amount  of  resources: 


k 


^  =  ^   a..x^ 


and  yield  a  defined  objective  function  value 

k 

j=l    ^  ^ 
Variables  x._|_,  ,...,x     are  allowed  to  vary.     The  original   prob- 
lem with  the  first  k  variables  fixed  becomes  CP^: 

k  n 

CP^:  I       r.x.^  +  max  [  r.x. 

j=l    ^  ^  j=k+l     ^  ^ 


n 

I 
j=k+l 


H  - 

such  that      I  a^.  .X.  <  b^  -  B^.  i  =  1: 


,m 


X.  =  0  or  1  j  =  k+1 ,. . .  ,n 

J 

At  any  particular  stage  the  solution  to  the  original   problem  must 

be  the  same  as  the  solution  to  one  of  the  candidate  problems. 

th 

If  all  candidate  problems  stayed  on  our  list,  then  at  the  n 

stage  we  would  have  2  candidate  problems  corresponding  to  the  2 
ways  of  setting  Xi,...,x  at  0  or  1. 

The  optimal  solution  to  IP  must  be  among  the  set  of  solutions  to 
the  2  candidate  problems.  Since  IP  is  a  maximization  problem,  the 
optimal  solution  is  that  candidate  problem  solution  which  has  the 
maximum  objective  function  value  H  r.x.^)   while  not  exceeding  its 
allowable  resources  (g.  $  b.  for  all  i). 

If  n  is  small  (less  than  10)  it  is  possible  but  tedious  to 
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evaluate  each  candidate  problem  and  compare.  For  n  large  it  is  theo- 
retically but  not  practically  possible. 

The  technique  of  the  algorithm,  therefore,  is  to  try  to  eliminate 
as  many  candidate  problems  as  possible  at  each  stage,  for  then  all 
their  descendants  are  likewise  eliminated. 

The  dynamic  programming  aspect  of  the  solution  is  in  the  stage  by 
stage  approach.  The  branch  and  bound  aspect  is  in  the  elimination  of 
descendants. 

A  candidate  problem  may  be  eliminated  by  a  variety  of  techniques 
for  two  basic  reasons:  1)  The  candidate  problem  is  infeasible  because 
it  requires  too  many  resources:  i.e.  £,-   >   b.^  for  some  i.  2)  All  of 
the  descendants  of  the  candidate  problem  can  be  shown  to  lead  to 
solutions  which  are  inferior  to  a  known  solution. 

At  each  stage  we  eliminate  as  many  candidate  problems  as  we  can. 
We  then  create  a  new  list  for  the  next  stage  by  creating  two  new  can- 
didate problems  from  each  surviving  one  by  fixing  the  next  variable  at 
both  0  and  1.  At  the  n   stage  we  have  in  our  list  a  number  of  pos- 
sible solutions.  We  then  compare  them  to  find  the  optimal  solutions. 

Before  launching  into  the  algorithm  itself,  we  would  like  to  de- 
scribe tv/o  basic  techniques  we  use  for  "getting  a  handle"  on  a  parti- 
cular candidate  problem.  We  create  simpler  problems  by  relaxing  some 
of  the  constraints  of  the  original  problem.  These  simpler  problems 
are  easier  to  solve  and  their  solutions  are  conveniently  related  to 
the  solution  of  the  original  problem. 

The  first  technique  is  to  relax  the  maximization  requirement  and 
apply  an  integer  programming  heuristic.  The  heuristic  solution  satis- 
fies the  conditions  for  the  problem  but  does  not  necessarily  maximize 
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the  objective  function  value.  A  heuristic  solution  can  be  considered 
a  lower  bound  for  an  optimal  solution.  We  use  Peterson's  heuristic  (10) 
for  its  power  and  Toyoda's  (16)  for  its  speed. 

The  second  technique  is  to  relax  the  integer  requirement.  We 
change  "x.  =  0  or  1"  to  the  "relaxed"  constraint  "0  <  x.   <  I".     This 
transforms  our  integer  programming  problem  to  a  linear  programming 
problem.  The  optimal  solution  to  the  linear  programming  problem 
might  be  impossible  for  the  integer  problem,  because  it  requires 
some  X.  to  be  non-integer,  but  its  objective  function  value  must  be 
greater  than  or  equal  to  that  of  the  original  problem  because  its 
constraints  are  not  as  tight.  Thus,  the  linear  programming  solution 
may  serve  as  an  upper  bound  for  the  integer  programming  solution. 

Algorithm  for  IP  (MMDP) 

Step  1.  Initialization 

Find  an  initial  lower  bound  (LB)  of  the  objective  function 
values  for  the  problem  by  using  Peterson's  heuristic  to  obtain  a 
satisfying  solution.  (Alternatively,  the  initial  LB  could  be  set  at  0). 

Set  k  =  1.  (k  is  the  stage  counter). 

Initialize  the  candidate  list  by  creating  tv/o  candidate  prob- 
lems from  the  original  integer  programming  problem,  one  with  Xj  set 
at  0  and  the  second  with  Xi  set  at  1. 

Set  LPCALL  >  1.  Note:  LPCALL  is  unnecessary  conceptually  but 
in  practice  is  used  to  save  machine  time  by  skipping  lengthy  elimina- 
tion tests  when  the  candidate  list  is  short.  (For  a  further  discus- 
sion see  the  chapter  on  results.) 

16 


step  2.  Infeasibility 

Eliminate  from  the  candidate  list  any  CP^  that  already  requires 
too  many  resources,  i.e. 

k 

e.*^  =  I       a^,-x.^  >  b.  for  some  i 

Step  3.  Dominance 

Eliminate  from  the  candidate  list  any  CP*^  which  is  dominated  by 
another  element  (CP  )  in  the  candidate  list. 

6.-  >  3^  for  all  i      CP  uses  no  more  of  any  resource  and 

y   r.x.^  <  I       r.x.      yields  a  higher  objective  function  value. 
3=1  ^  ^   j=l  -^  J 


Step  4.  Simple  Lower  Bound  Test 

Eliminate  from  the  candidate  list  any  element  CP*^  which  has  a 

maximum  possible  objective  function  value  less  than  the  current  lower 

bound. 

k        n 

I      ^^-  ^  ^    ^j  ^  L^ 

3=1  0  J   j=k+i  J 

step  5.  Linear  Programming  Bounding  Test 

If  the  number  of  elements  in  the  candidate  list  is  less  than 
LPCALL,  go  to  Step  6. 

Relax  each  candidate  problem  to^the  corresponding  linear  pro- 
gramming problem. 

Let  UB*^  denote  the  optimal  value  of  the  linear  programming 
solution  for  relaxed  CP^. 

If  UB^  <  LB  eliminate  CP"^. 

If  UB*^  >  LB  and  happens  to  have  integer  values  for  all  x's  then 
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set  LB  =  UB^.  Otherwise,  apply  a  heuristic  to  CP*^  giving  H^.  If 
H^  >  LB,  set  LB  =  H^. 

Note:  A  unique  feature  of  MMDP  is  the  efficient  way  in  which 
this  bounding  test  is  done.  For  a  complete  description,  see  the  next 
section  of  this  chapter. 
Step  6.  Prepare  for  the  Next  Stage  or  Finish 

Increase  k  by  1. 

If  k  <  n,  create  a  new  candidate  list  for  this  stage  by  splitting 
each  element  in  the  old  list  into  two  new  candidate  problems,  one 
with  x^^  set  at  0,  and  the  second  with  X|^  set  at  1.  Return  to  Step  2. 

If  k  >  n,  stop.  The  solution  is  the  element  in  the  candidate 
list  with  the  highest  objective  function  value. 

LP  Bounding  Test  (MMDP) 

VJe  enter  this  test  (Step  5  of  the  algorithm)  at  stage  k  with  a 
certain  number  of  candidate  problems  in  the  candidate  list,  say  0, 
Number  the  candidate  problems  CP^,...,CP^. 

Recall  that  with  each  CP^  there  is  associated  a  6  vector 
{Qi^,...,q  ^)  representing  the  resources  consumed  by  the  fixed 
variables  Xj  ,. . . ,x.^: 

w 


J      a.  .X. 

=1  ^J  J 


J  = 


The  overall  technique  of  this  section  is  to  find  an  upper  bound 
function  UB^  for  each  CP*^  by  solving  the  relaxed  (non-integer)  CP^^^ 
by  linear  programming.  CPr,*^  may  be  written: 

^   k  n 

CPp''  :  UB^  =  [   r  X  /'  +  max  I  r.x 

K         j  =  l  J  -^         j=k+l  -^   -J 
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n  i  =  1 , . . .  ,m 

such  that  I  a..x   ^  b.  -  6.^ 

j=k+l  ^"^  J     ^     ^     0  <  X.  <  1 

The  particular  technique  capitalizes  on  the  fact  that  at  a 

given  stage  k  every  candidate  problem  is  almost  the  same.  There  is 

k 
a  constant  term  J      r.x.^  to  be  added  to  the  maximized  term  which 

does  not  affect  the  maximization  process.  Otherwise,  only  the  re- 
source levels  (right  hand  sides)  vary.  In  the  dual  problem  the 
resource  levels  and  the  objective  function  coefficients  change  places. 
Thus,  all  candidate  problems  at  a  given  stage  have  identical  dual 
problems  except  for  the  objective  function.  Therefore,  they  can 
"share"  dual  solutions;  i.e.  any  feasible  solution  for  one  is  feasible 
for  all  (although  not  necessarily  optimal). 

CPp^  in  terms  of  its  dual  problem  becomes  dual  CPp^: 

m  n 

dual  CPn^:  constant  +  min  I  u  (b.-g.)  +  I  v 

^  i=l  ^  ^  ^     j=k+l  J 

m 

subject  to  y   u.a..  +  v.  >  r-    j  =  k+1, 
^=1  1  ij     J     J 


,n 


u^.  >  0 
v.  >  0 
To  exploit  this  opoortunity  for  sharing  dual  solutions,  Marsten 
and  Morin  (6)  create  a  parametric  tour  of  the  resource  space  which 
visits  B^,62,. . . ,3^. 

Suppose  that  the  above  has  been  solved  for  CPj^^  (3  =  3^  and 
that  we  are  in  the  process  of  obtaining  an  optimal  solution  for 
CPn^  (g  =  g2) by  parametric  programming  on  the  objective  function  of 
the  dual  problem.  We  travel  from  B^  to  6^  by  letting  3  =  B^  +  X 
($2  -  gi)  and  forcing  X  from  0  to  1.  At  each  iteration  (dual  simplex 

19 


pivot)  the  MMDP  program  nx)ves  to  a  new  dual  extreme  point  and  has  a 
new  opportunity  to  eliminate  not  only  CP^  but  also  CP3,...,CP  .  If 
CP^  is  eliminated,  the  6^  may  be  dropped  from  the  itinerary  of  the 
tour. 

The  results  chapter  of  this  thesis  lists  direct  and  indirect 
hits.  Both  derive  from  this  LP  bounding  test.  A  direct  hit,  for 
example,  occurs  if  candidate  problem  2  is  eliminated  on  the  path  to 
B^.  An  indirect  hit  occurs  if  candidate  problem  5  is  eliminated  on 
the  path  to  6^.  One  strength  of  this  algorithm  lies  in  the  fact  that 
if  the  candidate  list  is  long,  indirect  hits  vastly  outnumber  direct 
hits.  Indirect  hits  do  not  require  an  LP  pivot  but  only  a  simple 
inner  product  computation  and  therefore  save  a  great  deal  of  machine 
time. 

Expanded  LP  Bounding  Test 

Step  5.1.  Initialize 

Associate  with  each  CP^  a  "status"  function  S(q).  Initialize 
S(q)  =  1  for  all  q.  If  a  candidate  problem  CP*^  is  eliminated  from 
the  candidate  list,  we  shall  set  S(q)  =  0. 

Set  p  =  0     p  is  a  counter. 

Use  linear  programming  to  find  a  dual  feasible  solution 
UB^  for  CP^  (It  need  not  be  optimal.) 

Set  B  =  resources  consumed  by  this  solution. 

Go  to  Step  5.3. 
Step  5.2. 

Set  6  =  B^. 
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step  5.3.  Bookkeeping 

If  p  =  Q  or  S(q)  =  0  for  all  q  >  p,  go  to  step  5.8. 

Otherwise,  set  c  =  min  {q  >  p  ^{q)   =  l}.  6  is  the  starting 
point  for  the  next  parametric  segment.  6^  is  the  destination  of  the 
next  parametric  segment,  x  is  the  parameter  for  traveling. 

Set  X  =  0. 

Set  X  =  0. 

Set  6  =  B  +  x(6^  -  e)  in  the  dual  CPj^*^  equation. 
Step  5.4.  Parametric  Tour--Qne  Pivot 

Using  parametric  linear  programming  on  the  dual  CPj,^  equation, 
perform  one  basis  change  in  the  attempt  to  drive  X  from  x  to  1. 

Let  (u,  v)  be  the  resulting  dual  solution  and  set  x  =  current 
value  of  X. 

If  X  >  1,  set  p  =  c  and  go  to  step  5.7. 
Step  5.5.  "Shooting  Gallery":  Elimination  of  Candidate  Problems 

for  q  =  c,  c  +  1,. . .  ,Q: 

If  S(q)  =  1  and  if 

^   k      of"  «    1 

UB^  =  I   ^^^  +  1     -u(b-e.^)+I     V.  <  LB 
j=l  -^  -J    i  =  1  ^  ^  ^    j=k+l  J 

then  set  S(q)  =  0. 

Step  5.6.  More  Bookkeeping 

If  X  <  1  and  S(c)  =  1,  return  to  step  5.4. 

If  A  <  1  and  S(c)  =  0 

set  B  =  0  +  X  (6^  -  6) 

set  p  =  c 

return  to  step  5.3 
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If  X  =  1 

set  p  =  c 
Step  5.7.  Update  Lower  Bound 

If  the  linear  programming  solution  for  CP  is  all  integer,  then 
set 

LB  =  UB^ 
If  the  solution  is  not   integer,  use  Toyoda's  heuristic  to 
find  an  integer  solution. 

If  the  heuristic  solution  is  better  than  the  current  LB,  then 
let 

LB  =  heuristic  solution. 
Go  to  Step  5.2. 
Step  5.8.  Return 

Eliminate  from  the  candidate  list  all  CP^'s  with  S{q)  =  0. 
Proceed  to  step  6  of  the  MMDP  algorithm. 

Changes  Needed  for  Parametric  Problems 

Having  discussed  the  MflDP  algorithm  for  solving  an  integer  pro- 
gramming problem,  we  now  move  on  to  the  algorithm  for  solving  the 
parametric  integer  programming  program  with  varying  right  hand  sides 

n 
PIP:   max  7   r.x. 
j=l  J  J 

n 

such  that  y   a..x.  <  b.  +  0d.      i  =  l,...,m 
j  =  l  U  0    1    1 

X.  =  0  or  1 
0  <  0  <  1 
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r.  >0,  a..>0,  b.  >0,  d.  >0   for  i  =  1 , . . .  .m 

j  =  1,. . .  ,n 

Instead  of  seeking  one  solution,  we  are  now  seeking  a  series  of 
solutions  along  a  particular  line  segment  in  the  m-dimensional 
interval  [b,  B  +  d]. 

The  parameter  e  is  used  as  a  numeraire  so  that  all  points  along 
the  line  segment  from  B  to  B  +  D  can  be  isomorphically  mapped  onto 
the  line  segment  CO,l]. 

In  MMDP  we  proceeded  by  finding  a  current  "best"  solution  and 
labeling  its  objective  function  value  LB. 

In  the  parametric  algorithm  we  find  a  series  of  current  "best" 
solutions  and  label  their  objective  function  values  LB(0). 

Similarly,  the  concept  of  a  scalar  upper  bound  (UB)  is  replaced 
by  UB(0). 

Algorithm  for  PIP 

Step  1.  Initialization 

Set  k  =  1 

Set  LPCALL  >  1 

Set  LBNUM  >  1    Note:  LBNUM  is  unnecessary  conceptually  but 
in  practice  is  used  to  divide  the  interval  into  a  convenient  number 
of  smaller  intervals,  for  each  of  which  we  compute  a  lower  bound. 

Use  Peterson's  heuristic  to  create  an  initial  lower  bound 

function  LB(0)  by  solving  the  problem  at  the  points  0=0, 

1        LBNUM-1 
LBNUM  ,...,  LBNUM  . 
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Initialize  the  candidate  list  by  splitting  the  given  problem 
into  two  candidate  oroblems  with  Xi  set  at  0  and  Xj  set  at  1. 
Step  2.  Infeasibil ity 

Eliminate  from  the  candidate  list  any  CP^  that  already  requires 

too  many  resources.    ^i     -'   ^i  "''  '^i   ^^^  ^^^^  ^ 
Step  3.  Dominance 

Eliminate  from  the  candidate  list  any  CP  which  is  dominated 
by  another  element  (CP^)  in  the  candidate  list. 

B.     ^   6.   for  all  i    CP  uses  no  more  of  any  resource  and 

k        k        yields  a  higher  objective  function  value. 
I      r.x.     <  I       r.x. 
j=l  ^  ^        j=l  ^  ^ 

Step  4.  Simple  Lower  Bound  Test 

Eliminate  from  the  candidate  list  any  element  CP^  which  has  a 

maximum  possible  value  lower  than  the  current  lower  bound  at  e  =  0. 

1       ^x/^  +  1     ''i  <  LB  (0) 
j=l  -J  J    j  =  k+l  ^ 

Step  5.  Linear  Programming  Bounding  Test 

If  the  number  of  elements  in  the  candidate  list  is  less  than 
LPCALL,  go  to  step  6. 

Relax  each  candidate  problem  to  the  corresponding  linear  pro- 
gramming problem. 

Let  UB  (g)  denote  the  optimal  value  of  the  linear  programming 
solution  for  relaxed  CP^. 

If  UB^  (0)  <  LB(0)  for  all  0,  0^  <  0  <  1,  eliminate  CP'^. 

Otherwise,  a  heuristic  is  applied  to  CP  at  various  values  of 
0  giving  H^(0).  For  each  H^(0)  >  LB(0),  set  LB(0)  =  H^(0). 
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step  6.     Prepare  for  the  Next  Stage  or  Finish 
Increase  k  by  1. 

If  k  ^  n,  create  a  new  candidate  list  for  this  stage  by  split- 
ting each  element  in  the  old  list  into  two  new  candidate  problems, 
one  with  x,^  set  at  0,  and  the  other  with  x,    set  at  1.     Return  to 
step  2, 

If  k  >  n,  stop.     A  solution  s  is  included  in  the  optimal   solu- 
tion list  if  there  exists  no  other  solution  with  both  a  higher  ob- 
jective function  value  and  a  lower  o  value: 
for  all   q  f  s 
either  o^  <  0^  or 

objective  function  value  of  CP^  >  objective  function  value  CP^, 
Note:     Each  solution  q  has  an  associated  o^  which  is  the  smallest 
value  of  0  (0  i  0  <  1)  for  which  the  following  holds: 
g.  <  b.  +  0d.  i   =  1,. . .  ,m 

Expanded  LP  Bounding  Test--Parametric  Case 

Step  5.1.     Initialize 

Set  S(q)  =   1  for  all   q. 

Set  p  =  0. 

Use  linear  programming  to  find  a  dual  feasible  upper  bound 
function  UB^o)  for  CPi. 

Set  e*  =  the  resources  consumed  by  this  solution.  Go  to  step  5.3. 
Step  5.2. 

Set  p*  =  3^ 
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step  5.3.  Bookkeeping 

If  p  =  0  or  S(q)  =  0  for  all  q  >  p,  go  to  steo  5.9. 

Otherwise,  set  c  =  min  {q  >  p  |  S(q)  =  1} 

Set  X  =  0 

Set  X  =  0 

Set  6  =  e  +  X  (6^  -  6) 
Step  5.4.  Parametric  Tour--One  Pivot 

Using  parametric  linear  programming,  perform  one  basis  change  in 
the  attempt  to  drive  X  from  x  to  1. 

Let  (u,v)  be  the  resulting  dual  solution  and  set  x  =  current 
value  of  X. 

If  X  >  1,  set  p  =  c  and  go  to  step  5.7. 
Step  5.5.  "Shooting  Gallery" 

for  q  =  c,  c  +  1,. . .  ,Q 

If  s(q)  =  1  and  if 

UB^  (0)  =  I     r.x.^  +  I     u.   (b.  +  0d.  -  B.'^)  +  I        v  <  LB(0) 
j=l  ^  ^         i  =  l  '   ^     ^    ^     j=k+l  -^ 

for  all  values  of  0  from  0*^  to  1 

then  set  s(q)  =  0. 

Note:  0^  is  the  smallest  value  of  0  (0  <  0  <  1)  for  which  the 

following  holds: 

g.^  <  b.  +  0d^.     i  =  l,...,m 
Step  5.6.  More  Bookkeeping 

If  X  <  1  and  S(c)  =  1,  return  to  step  5.4. 
If  X  <  1  and  S(c)  =  0 

set  6  =  B  +  X  (B*^  -  B) 

set  p  =  c 
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return  to  step  5.3 

If  X  =  1 
set  p  =  c 
Step  5.7.  Extended  Upper  Bound  Test 

Set  B  =  6'  +  X  {(1  -  0)D  -  B*^} 

Using  parametric  linear  programming,  drive  x   from  0  to  1. 

This  generates  a  tighter  UB  (e)  function  than  the  linear 
approximation  used  in  step  5.5. 

If  UB^  (e)  <  LB  (0)  for  all  values  of  0  from  0^  to  1,  then  set 
s(q)  =  0. 
Step  5.8.  Update  Lower  Bound  Function 

Use  Toyoda's  heuristic  to  generate  LBNUM  solutions  H  (0)  to 

CP^  at 

n    1         LBNUM-1 
"  ~  '  LBNUM  '  •••  '  "LBNUM 

For  each  H  (0)  >  LB  (0)  set  LB  (0)  =  H  (0) 

Return  to  step  5.2. 

Step  5.9.  Return 

Eliminate  from  the  candidate  list  all  CP^^'s  with  s(q)  =  0. 

Proceed  to  step  6  of  the  parametric  integer  programming  algorithm. 
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IV.  RESULTS 

This  chapter  presents  a  summary  of  our  results  from  applying 
our  computer  algorithm  to  specific  parametric  integer  programs. 
We  will  present  two  types  of  results:  first,  those  which  show  the 
effects  of  varying  parameters  under  the  user's  control;  and  second, 
those  which  explore  the  "solution  space"  of  parametric  integer 
programs. 

Once  the  original  integer  program  is  decided  upon,  three  para- 
meters are  under  the  control  of  the  user:  LPCALL,  the  minimum 
number  of  candidate  problems  necessary  to  initiate  linear  pro- 
gramming (LP)  bounding;  LBNUM,  the  number  of  steos  in  the  lower 
bound  function  (LB(0));  and  the  size  of  the  D  vector  compared  to 
the  B  vector.  We  shall  consider  each  of  these  in  turn,  with  parti- 
cular emphasis  on  how  each  parameter  affects  the  execution  time  of 
the  algorithm. 

LPCALL 

LPCALL  controls  the  execution  of  Step  5  in  the  algorithm.  It 
determines  whether  there  are  enough  candidate  problems  to  warrant 
using  the  LP  bounding  tests — if  there  are  more  candidate  problems 
on  the  list  than  the  value  of  LPCALL,  then  the  LP  bounding  takes 
place.  Note  that  LPCALL  does  not  influence  the  results  of  the  LP 
bounding  test;  there  is  no  assurance  that  the  bounding  test  will  re- 
duce the  number  of  candidate  problems  to  less  than  the  value  of 

LPCALL. 
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LPCALL  represents  the  classic  trade-off  between  execution  time 
and  core  storage.  For  small  values  of  LPCALL  (1  to  50),  the  number 
of  candidate  problems  is  kept  reasonably  small,  and  the  candidate 
list  uses  little  storage  (each  candidate  problem  currently  occupies 
176  bytes;  this  amount  depends  on  the  number  of  constraints).  For 
larger  values  of  LPCALL  (say  100  to  500),  the  candidate  list  may 
grow  rather  large;  this  requires  much  more  storage. 

We  have  discovered  experimentally  that  execution  time  decreases 
as  LPCALL  increases.  This  is  illustrated  in  Figure  1.  In  this 
example,  execution  time  was  decreased  over  4- fold  by  increasing 
LPCALL  from  1  to  200.  We  have  found  similar  results  in  all  problems 
we  have  tested. 

The  beginnings  of  an  explanation  for  this  time-storage  trade-off 
can  be  seen  in  Table  1,  which  presents  the  number  of  times  the  LP 
bounding  step  was  executed  for  various  values  of  LPCALL.  Execution 
time  decreases  when  the  LP  bounding  is  used  less  frequently.  Note 
also  from  the  table  how  the  maximum  candidate  list  size  increases 
with  LPCALL. 

Our  explanation  for  this  time-storage  trade-off  is  based  on  the 
following  reasoning:  When  the  value  of  LPCALL  is  small,  most  of  the 
fathoming  of  candidate  problems  occurs  in  the  LP  bounding  step. 
Few  candidate  problems  are  fathomed  by  the  less  strict  non-LP 
bounding  tests  in  Steps  2,  3  and  4.  Further,  the  LP  bounding  typi- 
cally fathoms  50%  of  the  list  or  less.  This  can  be  seen  from  Table  2, 
which  reproduces  the  results  from  a  run  with  LPCALL  equal  to  25. 
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Figure  1.     Effect  of  varying  LPCALL  on  execution  time, 


30 


LPCALL 

Max^ 
Cand- 

imura  1 
idate 

Size 
List 

Ti 
LP 

imes 
Used 

Total 
Time 

1 

37 

14 

5.7 

10 

37 

11 

5.3 

25 

45 

6 

3.6 

50 

63 

2 

1.7 

100 

140 

1 

1.4 

150 

230 

1 

1.4 

200 

261 

0 

1.2 

Table  1.  Effect  of  varying  LPCALL. 
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When  the  value  of  LPCALL  is  larger,  the  LP  bounding  test  is 
executed  less  often.  The  less  tight  non-LP  bounding  tests  of 
Steps  2,  3  and  4  get  more  chances  to  fathom  candidate  problems. 
Although  they  are  not  as  effective  in  eliminating  candidate  problems, 
they  are  much  faster.  Large  values  of  LPCALL  allow  these  steps  to 
work  closer  to  their  full  potential.  Further,  when  Step  5  does  need 
to  be  executed,  it  decimates  the  candidate  list,  frequently  fathoming 
over  70%  of  it.  Most  of  these  candidate  problems  are  fathomed  by 
what  we  call  "indirect  hits",  where  the  candidate  problem  is 
fathomed  while  the  routine  is  concentrating  on  fathoming  another 
candidate  problem.  An  indirect  hit  is  essentially  free  and  requires 
very  little  time  compared  to  a  direct  hit.  Small  values  of  LPCALL, 
we  have  discovered,  result  in  a  low  ratio  of  indirect  to  direct  hits. 
Large  values  result  in  a  high  ratio,  frequently  greater  than  10:1. 
To  summarize,  large  values  of  LPCALL  seem  to  decrease  execution  time 
because  more  candidate  problems  are  fathomed  by  time-efficient  means-- 
Steps  2,  3,  and  4,  and  indirect  hits.  Table  3  reproduces  a  run  with 
LPCALL  equal  to  100. 

LBNUM 

LBNUM  is  the  number  of  steps  in  the  lower  bound  function  (LB(o)). 
This  function  is  used  in  the  LP  bounding  test  (Step  5)  as  the  current 
"best"  solutions  to  which  the  candidate  problem  is  comnared. 

Since  the  steos  in  the  lower  bound  function  are  fixed  points, 
the  larger  the  number  of  steps  (the  greater  the  value  of  LBNUM),  the 
closer  LB(o)  can  approximate  the  optimal  solution  (see  Figures  2  and  3), 
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Figure  2.     Lower  bound  function  as  an  approximation  to  the  optimal 
objective  function.     LBNUM=4 
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Figure  3.     Lower  bound  function  as  an  approximation  to  the  optimal 
objective  function.     LBNUM=8 
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The  closer  LB(0)  follows  the  optimal  solution,  the  tighter  a  bounding 
test  it  can  provide.  This  argues  for  as  large  a  value  of  LBNUM  as 
possible. 

On  the  other  hand,  in  Steps  1  and  5  in  the  algorithm,  a  heuristic 
is  applied  at  each  break  point  in  LB(9).  Thus,  the  heuristic  is 
applied  LBNUM  times  at  Step  1  (and  we  employ  a  powerful  but  \/ery   time 
consuming  heuristic)  and  LBNUM  times  for  every  surviving  candidate 
problem  in  Step  5.  If  Step  5  is  executed  10  times  and  the  average 
number  of  surviving  candidate  problems  is  30,  then  this  heuristic 
is  executed  300  times  for  each  step  in  LB{9).  If  LBNUM  =  20  (a 
typical  value),  the  heuristic  is  used  6000  times  during  the  execu- 
tion of  the  program.  Generally,  50%  to  80%  of  the  total  execution 
time  is  spent  on  the  heuristic  at  Step  5.  This  argues  for  a  small 
value  of  LBNUM. 

Based  on  our  experience,  the  optimal  value  of  LBNUM  is  approxi- 
mately 50%  to  100%  of  the  number  of  optimal  solutions.  As  LBNUM  is 
decreased  below  this  point,  too  many  candidate  problems  "pass"  the 
LP  bounding  test  and  raise  execution  time  in  the  heuristic  and  later 
bounding  tests.  Large  values  of  LBNUM  consume  more  time  in  the 
heuristics  than  they  save  by  eliminating  a  few  extra  candidate 
problems.  Figures  4  and  5  demonstrate  this  trade-off. 

Size  of  D  Vector 

D  is  the  variable  resource  parameter;  the  parametric  integer 
problem  is  solved  for  resource  levels  varying  from  B  to  B+D.  For 
D  =  (0),  the  problem  reduces  to  an  integer  problem  and  has  only  one 
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solution.  As  D  increases  from  (0),  the  number  of  solutions  in- 
creases and  the  computer's  work  increases  correspondinqly. 

We  discovered  experimentally  that  the  execution  time  increases 

* 
exponentially  as  D  increases  as  a  percentage  of  B.   This  is  demon- 
strated in  Figure  5  which  shows  execution  time  versus  the  ratio  of 
D  to  B.  The  figure  shows  results  for  various  values  of  LBNUM.  As 
can  be  seen,  larger  values  of  LBNUM  reduce  the  rate  of  growth  in 
execution  time.  As  noted  above,  the  algorithm  performs  best  when 
LBNUM  is  50%  to  100%  of  the  number  of  optimal  solutions,  which  is  a 
function  of  the  size  of  D. 

When  one  wants  to  explore  a  problem  with  a  large  D  vector,  one 
possible  technique  is  to  break  the  problem  into  a  number  of  sub- 
problems;  i.e.,  instead  of  solving  B  to  B+D,  solve  B  to  B+1/3D, 
B+1/3D  to  B+2/3D,  and  B+2/3D  to  B+D.  For  many  problems,  this  causes 
a  dramatic  reduction  in  total  execution  time  and  allows  one  to  solve 
problems  that  could  not  be  otherwise  solved  due  to  core  restriction. 
Figure  6  is  an  illustration  of  this  phenomenon. 

Density  of  the  Solution  Space 

Starting  at  the  origin  (or  at  any  arbitrary  point  B  in  resource 
space),  one  can  derive  a  set  of  solutions  by  traveling  along  the 
line  segment  from  B  to  B+D.  If  D  is  large  enough,  the  solution  set 


The  relevant  factor  actually  seems  to  be  the  ratio  of  d^-  to 
y  a..;  the  size  of  d-  to  all  of  the  desire  for  resources.  We  use 

the  fixed  value  b.  as  a  surrogate  for  ^  a-jj- 

J 
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Figure  6.  Effect  of  breaking  a  large  problem  into  2,4,  or  5  smaller 
problems  on  execution  time. 
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will  include  the  largest  possible  solution  in  which  all  of  the 
Xj  are  1. 

Two  interesting  questions  are:  1)  the  distribution  of  solu- 
tions as  a  function  of  0,  and  2)  how  the  solutions  change  as  one 
travels  along  different  paths. 

Figure  7  and  Table  4  present  the  value  of  the  objective  func- 
tion for  all  solutions  for  a  particular  PIP  with  B  set  at  zero  and 
D  set  at  the  smallest  value  for  which  all  x. 's  are  equal  to  1. 
This  then  shows  all  the  solutions  between  the  solution  x-  =  0  for 
all  j  and  x.  =  1  for  all  j.  As  can  be  seen,  the  solution  is  rela- 
tively  uniformly  dispersed  as  a  function  of  0,  although  the  segment 
(.09,  .46)  is  the  densest. 

Figure  8  demonstrates  how  the  solution  set  changes  as  one  con- 
siders different  oaths.  Along  one  path  we  found  13  solutions  between 
X-  =  0  for  all  j  and  x.  =  1  for  all  ];   along  others  we  found  16  and 
18  solutions.  Among  the  three  paths  we  found  a  total  of  20  unique 
solutions. 

Summary  of  Results 

To  summarize  our  results,  we  found  that  LPCALL  should  be  set 
as  large  as  possible,  which  is  one-half  of  the  maximum  possible 
length  of  the  candidate  list  (currently  the  maximum  for  LPCALL  is 

300). 

LBNUM  and  the  D  vector  need  to  be  determined  interdependently. 
As  a  rule  of  thumb,  we  suggest  running  your  problem  with  a  small  D, 
within  2  to  S%   of  the  B  vector,  with  LBNUM  =  10  to  20.  From  the 
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Figure  7.  Objective  function  values  for  all  solutions  of  the 
5  by  15  problem  between  all  x.=0  and  all  x.=l  along  a  particular 
vector.  "^  ^ 
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Objective  Function  Value 


Objective  Function  Value 


0.0000 

0 

.4279 

4569 

.0536 

335 

.4322 

4802 

.0906 

528 

.4469 

4815 

.0988 

548 

.4558 

5118 

.1049 

651 

.4788 

5350 

.1115 

864 

.4954 

5405 

.1186 

980 

.5026 

5666 

.1257 

1000 

.5409 

5740 

.1386 

1179 

.5441 

5830 

.1390 

1199 

.5681 

6045 

.1411 

1315 

.5813 

6146 

.1620 

1807 

.5952 

6165 

.1977 

1824 

.5968 

6176 

.1978 

2142 

.6102 

6341 

.2203 

2294 

.6195 

6676 

.2351 

2355 

.6602 

6869 

.2376 

2458 

.6755 

6992 

.2431 

2508 

.6847 

7156 

.2532 

2680 

.7152 

7297 

.2615 

2690 

.7201 

7491 

.2708 

2745 

.7539 

7508 

.2750 

2799 

.7754 

7796 

.2819 

2844 

.7795 

7807 

.2890 

3122 

.7909 

7843 

.2920 

3228 

.8068 

8112 

.3042 

3487 

.8476 

8148 

.3253 

3822 

.8679 

8186 

.3568 

3842 

.8819 

8203 

.3660 

3858 

.8862 

8295 

.3685 

3986 

.9228 

8331 

.3692 

4035 

.9232 

8342 

.3716 

4138 

.9273 

8538 

.3815 

4158 

.9447 

8611 

.3882 

4253 

.9518 

8647 

.3956 

4370 

.9827 

8658 

.4112 

4425 

.9880 

8694 

.4127 

4524 

1.0000 

8803 

.4264 

4543 

Table  4.  Objective  function  value  and  the  corresponding  ©  for 
the  5  by  15  problem  with  B  =  (0,0,0,0,0)  with  the  solution  all 
X.  =  0,  and  D  =  (1327,1211,1082,971,1180)  with  the  solution  all 
x"?  =  1. 
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Figure  8.   Solutions  to  the  5  by  5  problem  along  three 
different  paths. 
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number  of  solutions  found  in  this  small  range,  linearly  extrapolate 
the  number  of  solutions  to  the  range  of  the  actual  D  vector  you  wish 
to  use.  Run  the  large  problem  with  LBNUM  equal  to  50%  to  100%  of 
this  number.  For  D  vectors  with  an  estimated  number  of  solutions 
over  50,  consider  splitting  the  problem  into  a  number  of  sub-problems, 
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V.  HOW  TO  USE  THE  PROGRAM 

Input  Fonnat 

Five  or  more  lines  or  cards  must  be  read  in  to  initialize  the 
program. 

Line  1^:  This  line  has  7  right-justified  5-digit  integers: 
Cols:    1-5   M  -  the  number  of  constraints 

6-10   N  -  the  number  of  variables  (stages) 
11-15   KFLAG  -  1  in  column  15,  indicating  that  the 

variables  are  restricted  to  0  or  1. 
16-20   LFLAG  -  1  in  column  20,  indicating  that  the 

problem  is  linear. 
21-25   IBFLAG  -  1  in  column  25,  indicating  that  bound- 
ing will  be  used, 
26-30   I  PARA  -  2  in  column  30  calls  for  the  parametric 

program. 
31-35   LPCALL  -  the  threshold  for  calling  the  LP 

bounding  test,  normally  set  at  300  (columns  33-35) 
See  Results  chapter  for  discussion  on  varying 
LPCALL. 
36-40   IDFLAG  -  0  in  column  40  calls  for  a  fixed  percent 
increase  in  all  right  hand  sides,  the  percent  to 
be  read  in  on  Line  4. 

1  in  column  40  calls  for  a  specific 
(0  or  positive)  increase  in  each  right  hand  side 
to  be  read  in  at  Line  4. 
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Line  2:  This  line  has  one  right-justified  5-digit  integer: 

Cols:    1-5   IPRINT  -  the  digit  in  column  5  controls  the 
amount  of  output  printed: 

0  indicates  print  solutions,  resources  consumed, 
objective  function  value,  and  theta. 

1  indicates  print  resources,  objective  value, 
and  theta. 

2  indicates  print  objective  value  and  theta. 

3  indicates  print  only  the  number  of  solutions. 
Line  3:  This  line  (or  lines)  contains  the  initial  B  vector  (right 

hand  side  or  resources).  Five  columns  are  used  for  each 
number.  M  (defined  on  Line  1)  integer  or  decimal  numbers 
are  read  in.  Note  that  a  decimal  point  consumes  a  space. 
Integers  must  be  right-justified.  Numbers  with  decimal 
points  may  be  placed  anywhere  in  the  5-digit  field.  A  maxi- 
mum of  16  numbers  may  be  included  in  each  line.  If  M  >  16, 
continue  the  numbers  on  a  subsequent  line  or  lines.  The 
Fortran  format  statement  used  is  (16F5.0). 
Line  4:  If  IDFLAG  (defined  on  Line  1)  is  set  to  0,  then  a  decimal 
number  is  read  in  from  the  first  5  columns;  e.g.,  for  an 
increase  of  20%,  type  .2  or  0.2  or  0.20,  etc. 
If  IDFLAG  is  set  to  1,  then  M  integer  or  decimal  numbers  are 
read  in,  formatted  as  in  Line  3.  They  may  be  zero  or  posi- 
tive. Each  number  represents  the  increase  allowed  in  the 
corresponding  resource. 
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Line  5:  Columns  1-5  contain  LBNUM.  This  is  a  right-justified 

integer  from  1  to  50.  This  integer  defines  the  number  of 
equal  pieces  into  which  the  space  from  the  original  resources 
(B)  to  the  new  resources  (B+D)  is  divided,  for  purposes  of 
calculation.  Any  number  will  work,  but  a  judicious  choice 
of  number  will  decrease  calculating  time.  The  size  of  the 
problem  and  the  number  of  solutions  expected  influence  this 
choice.  For  a  discussion  of  selection  criteria,  see  the 
chapter  on  Results. 

Line  6  and  continuing:  These  lines  contain  the  constraint  and  objec- 
tive function  coefficients  in  the  same  format  as  Line  3. 
There  should  be  one  or  more  lines  for  each  x.  variable. 
The  first  line  and  continuing  lines,  if  needed,  contains 
the  first  column  of  the  coefficient  matrix  (A)  plus  the 
first  element  of  the  objective  function  (R).  The  second 
line  contains  the  second  column  of  the  A  matrix  plus  the 
second  element  of  R,  and  so  forth. 

Sample  Input  and  Output 

To  assist  the  reader  in  understanding  the  input  format  and  the 
resulting  output,  we  present  the  5  b}^  15  problem  used  as  an  example 
in  the  Results  chapter.  Figure  9  gives  the  mathematical  statement 
of  the  problem,  figure  10  presents  the  output  from  running  the  data 
with  our  computer  algorithm,  and  figure  11  reproduces  the  input  data 
set. 
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Figure  11.     Typical   computer  input  for  using  the  parametric  integer 
programming  algorithm,      (The  5  by  15  problem  given  in  figure  9) 
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VI.  AREAS  FOR  FURTHER  RESEARCH 

We  can  suggest  a  number  of  modifications  which  will  extend  the 
range  of  problems  solvable  by  both  the  basic  integer  programming 
algorithm  and  our  extension  of  it  for  parametric  integer  programming 
probl ems . 

Removing  the  non-negativity  restriction  of  the  basic  integer 
prograrming  algorithm  would  allow  the  solving  of  all  zero-one 
integer  programming  problems.  This  would  require  two  modifications: 
eliminating  the  infeas-ibility  test  (Step  2  of  the  algorithm),  and 
developing  a  heuristic  which  can  handle  negative  values  in  the  con- 
straint matrix.  We  expect  developing  the  heuristic  to  be  the  more 
difficult  task.  Extending  this  to  the  parametric  case  would  be  a 
trivial  exercise. 

The  basic  integer  programming  algorithm  currently  solves  only 
pure  integer  problems.  It  could  be  extended  to  solve  mixed  integer 
problems  in  which  some  variables  are  continuous  and  others  are 
integer  by  the  following  technique:  Order  the  variables  so  that  the 
integer  variables  are  first.  Suppose  there  are  k  integer  variables. 
Solve  the  problem  through  stage  k.  At  the  end  of  this  stage,  all 
of  the  integer  variables  have  been  fixed  at  zero  or  one.  Further, 
the  remaining  continuous  variables  have  been  optimized  over  their 
continuous  domains  in  obtaining  the  linear  programming  upoer  bound 
in  Step  5.  The  optimal  solution  may  be  selected  immediately  at  this 
point  by  choosing  the  candidate  problem  with  the  greatest  upper  bound. 
The  challenge  in  implementing  this  will  be  in  developing  an  appropriate 
mixed  integer  heuristic  for  finding  incumbent  solutions.  The  current 
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pure  integer  heuristics  may  be  used,  although  they  will  not  be  as 
powerful  as  one  specifically  designed  for  mixed  integer  problems. 

The  oarametric  integer  programming  algorithm  can  be  extended 
in  two  ways.  The  first  would  be  to  remove  the  restriction  that  the 
variable  resource  vector  be  non-negative.  The  primary  modification 
required  would  be  in  determining  the  range  over  which  a  candidate 
problem  is  feasible.  Instead  of  being  feasible  over  the  range 
[]0^,l]|  where  O<0^<1,  the  typical  candidate  problem  will  be  feasible 
over  the  more  limited  range  [o  ,0  J  where  O<0^<0'^  <1. 

The  second  extension  of  the  parametric  integer  programming 
algorithm  would  be  to  solve  for  all  the  optimal  solutions  in  the 
m-dimensional  box  with  vertices  at  B  and  B+D  rather  than  just  the 
solution  along  the  line  segment  connecting  B  and  B+D.  The  primary 
difficulty  would  be  in  handling,  comparing,  and  coherently  displaying 
the  myriad  of  solutions  generated. 
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SUBROUTINE  LBTEST ( LBFLAG  »  RXUTB  r  UTD  f THETA , CROSS ) 

COMMON/LBSTUF/LBNUM » LBVAL 

DIMENSION  LBVAL(50) 

REAL  LBUAL 
C************  ***************>>:**  ********************* 
C 

C  LBFLAG=1  MEANS  LBTEST  CANNOT  FATHOM  CANDIDATE 
C  LBFLAG=2  MEANS  LBTEST  CAN  (DOES)  FATHOM  CANDIDATE 
C 

C  CROSS  IS  THE  POINT  IN  THETA  THAT  THE  FATHOM  TEST  FAILS 
C 
C************************* *************************** ****** 

IF(THETA.GT»1. )G0  TO  2000 

IF < THETA. EQ. 0. )  GO  TO  200 

I=(THETA*LBNUM)i:l 

IF  (I  ,GT.  LBNUM)  I  =  LBNUM 

ISTART=I 

IF(RXUTB+THETA*UTD.GT.LBVAL(I))  GO  TO  3000 

GO  TO  210  I 

200  1=1  J 

ISTART=I 
210  TEMP=FLOAT(I)/FLOAT(LBNUM) 

IF<RXUTB-}TEMP*UTD,GT.LByAL(I)  )G0  TO  1000 
250  1=1+1 

IF  (I.LE.LBNUM)GO  TO  210 

IF(UTD.NE.0.)G0  TO  2000 

IF(RXUTB,Ea,LBVAL(ISTART))GO  TO  3000 

GO  TO  2000 
1000  LBFLAG=1 

IF  (UTD.EQ.O. )G0  TO  1100 

CROSS= ( LBVAL  < I ) -RXUTB ) /UTD 

RETURN 
1100  CROSS=TEMP 

RETURN 
2000  LBFLAG=2 

RETURN 
3000  LBFLAG=1 

CROSS=THETA 

RETURN 

END 
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